Parameters describing multimodal interaction - definitions and three usage scenarios
نویسندگان
چکیده
While multimodal systems are an active research field, there is no agreed-upon set of multimodal interaction parameters, which would allow to quantify the performance of such systems and their underlying modules, and would therefor be necessary for a systematic evaluation. In this paper we propose an extension to established parameters describing the interaction with spoken dialog systems [1] in order to be used for multimodal systems. Focussing on the evaluation of a multimodal system, three usage scenarios for these parameters are given.
منابع مشابه
Describing Multimodal Human-Computer Interaction
In this paper we argue that approaches to annotate multimodal human face-to-face interaction are not suitable for current device-based human-computer interaction. Instead, existing extensions proposed to established parameters describing the interaction with spoken dialog systems are presented and discussed. A standardization activity for annotating user interactions with multimodal systems is ...
متن کاملITU-T Rec. Series P Supplement 25 (01/2011) Parameters describing the interaction with multimodal dialogue systems
متن کامل
Modeling input modality choice in mobile graphical and speech interfaces
In this paper, we review three experiments with a mobile application that integrates graphical input with a touch-screen and a speech interface and develop a model for input modality choice in multimodal interaction. The model aims to enable simulation of multimodal human–computer interaction for automatic usability evaluation. The experimental results indicate that modality efficiency and inpu...
متن کاملVirtual Modality: A Framework For Testing And Building Multimodal Applications
This paper introduces a method that generates simulated multimodal input to be used in testing multimodal system implementations, as well as to build statistically motivated multimodal integration modules. The generation of such data is inspired by the fact that true multimodal data, recorded from real usage scenarios, is difficult and costly to obtain in large amounts. On the other hand, thank...
متن کاملDesigning Multimodal Interactive Systems
The design of interactive systems, with novel devices or scenarios, is a complex task, given that none, or almost none, information regarding its use is available. This paper argues for a design process that leverages the availability of new interactive devices to build high-fidelity prototypes that allow for unconstrained usage, thus immersing the user in the interaction scenario. Based on fin...
متن کامل